Magnetic Resonance Imaging, Clinical, and Biopsy Findings in Suspected Prostate Cancer: A Systematic Review and Meta-Analysis.

Importance: Multiple strategies integrating magnetic resonance imaging (MRI) and clinical data have been proposed to determine the need for a prostate biopsy in men with suspected clinically significant prostate cancer (csPCa) (Gleason score ≥3 + 4). However, inconsistencies across different strategies create challenges for drawing a definitive conclusion. Objective: To determine the optimal prostate biopsy decision-making strategy for avoiding unnecessary biopsies and minimizing the risk of missing csPCa by combining MRI Prostate Imaging Reporting & Data System (PI-RADS) and clinical data. Data Sources: PubMed, Ovid MEDLINE, Embase, Web of Science, and Cochrane Library from inception to July 1, 2022. Study Selection: English-language studies that evaluated men with suspected but not confirmed csPCa who underwent MRI PI-RADS followed by prostate biopsy were included. Each study had proposed a biopsy plan by combining PI-RADS and clinical data. Data Extraction and Synthesis: Studies were independently assessed for eligibility for inclusion. Quality of studies was appraised using the Quality Assessment of Diagnostic Accuracy Studies 2 tool and the Newcastle-Ottawa Scale. Mixed-effects meta-analyses and meta-regression models with multimodel inference were performed. Reporting of this study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline. Main Outcomes and Measures: Independent risk factors of csPCa were determined by performing meta-regression between the rate of csPCa and PI-RADS and clinical parameters. Yields of different biopsy strategies were assessed by performing diagnostic meta-analysis. Results: The analyses included 72 studies comprising 36 366 patients. Univariable meta-regression showed that PI-RADS 4 (ß-coefficient [SE], 7.82 [3.85]; P = .045) and PI-RADS 5 (ß-coefficient [SE], 23.18 [4.46]; P < .001) lesions, but not PI-RADS 3 lesions (ß-coefficient [SE], -4.08 [3.06]; P = .19), were significantly associated with a higher risk of csPCa. When considered jointly in a multivariable model, prostate-specific antigen density (PSAD) was the only clinical variable significantly associated with csPCa (ß-coefficient [SE], 15.50 [5.14]; P < .001) besides PI-RADS 5 (ß-coefficient [SE], 9.19 [3.33]; P < .001). Avoiding biopsy in patients with lesions with PI-RADS category of 3 or less and PSAD less than 0.10 (vs <0.15) ng/mL2 resulted in reducing 30% (vs 48%) of unnecessary biopsies (compared with performing biopsy in all suspected patients), with an estimated sensitivity of 97% (vs 95%) and number needed to harm of 17 (vs 15). Conclusions and Relevance: These findings suggest that in patients with suspected csPCa, patient-tailored prostate biopsy decisions based on PI-RADS and PSAD could prevent unnecessary procedures while maintaining high sensitivity.

Clinical indications, safety, and effectiveness of percutaneous image-guided adrenal mass biopsy: an 8-year retrospective analysis in 160 patients.

PURPOSE: To assess indications, safety, and effectiveness of percutaneous adrenal mass biopsy in contemporary practice. METHODS: This institutional review board-approved, retrospective study included all patients undergoing percutaneous image-guided adrenal mass biopsies at an academic health system from January 6, 2015, to January 6, 2023. Patient demographics, biopsy indications, mass size, laboratory data, pathology results, and complications were recorded. Final diagnoses were based on pathology or ≥ 1 year of imaging follow-up when biopsy specimens did not yield malignant tissue. Test performance calculations excluded repeat biopsies. Continuous variables were compared with Student's t test, dichotomous variables with chi-squared test. RESULTS: A total of 160 patients underwent 186 biopsies. Biopsies were indicated to diagnose metastatic disease (139/186; 74.7%), for oncologic research only (27/186; 14.5%), diagnose metastatic disease and oncologic research (15/186; 8%), and diagnose an incidental adrenal mass (5/186; 2.7%). Biopsy specimens were diagnostic in 154 patients (96.3%) and non-diagnostic in 6 (3.8%). Diagnostic biopsies yielded malignant tissue (n = 136), benign adrenal tissue (n = 12), and benign adrenal neoplasms (n = 6) with sensitivity = 98.6% (136/138), specificity = 100% (16/16), positive predictive value = 100% (136/136), and negative predictive value = 88.9% (16/18). Adverse events followed 11/186 procedures (5.9%) and most minor (7/11, 63.6%). The adverse event rate was similar whether tissue was obtained for clinical or research purposes (10/144; 6.9% vs. 1/42; 2.4%, p = 0.27), despite more specimens obtained for research (5.8 vs. 3.7, p < 0.001). CONCLUSION: Percutaneous adrenal mass biopsy is safe, accurate, and utilized almost exclusively to diagnose metastatic disease or for oncologic research. The negative predictive value is high when diagnostic tissue samples are obtained. Obtaining specimens for research does not increase adverse event risk.

Risk of Malignancy in Incidentally Detected Lung Nodules in Patients Aged Younger Than 35 Years.

BACKGROUND: The risk of malignancy in pulmonary nodules incidentally detected on computed tomography (CT) in patients who are aged younger than 35 years is unclear. OBJECTIVE: The aim of this study was to evaluate the incidence of lung cancer in incidental pulmonary nodules in patients who are 15-34 years old. METHODS: This retrospective study included patients aged 15-34 years who had an incidental pulmonary nodule on chest CT from 2010 to 2018 at our hospital. Patients with prior, current, or suspected malignancy were excluded. A chart review identified patients with diagnosis of malignancy. Incidental pulmonary nodule was deemed benign if stable or resolved on a follow-up CT at least 2 years after initial or if there was a medical visit in our health care network at least 2 years after initial CT without diagnosis of malignancy.Receiver operating characteristic curve analysis was performed with nodule size. Association of categorical variables with lung cancer diagnosis was performed with Fisher exact test, and association of continuous variables was performed with logistic regression. RESULTS: Five thousand three hundred fifty-five chest CTs performed on patients aged 15-34 years between January 2010 and December 2018. After excluding patients without a reported pulmonary nodule and prior or current malignancy, there were a total of 779 patients. Of these, 690 (89%) had clinical or imaging follow-up after initial imaging. Of these, 545 (70% of total patients) patients had imaging or clinical follow-up greater than 2 years after their initial imaging.A malignant diagnosis was established in 2/779 patients (0.3%; 95% confidence interval, 0.1%-0.9%). Nodule size was strongly associated with malignancy (P = 0.007), with area under the receiver operating characteristic curve of 0.97. There were no malignant nodules that were less than 10 mm in size. Smoking history, number of nodules, and nodule density were not associated with malignancy. CONCLUSIONS: Risk of malignancy for incidentally detected pulmonary nodules in patients aged 15-34 years is extremely small (0.3%). There were no malignant nodules that were less than 10 mm in size. Routine follow-up of subcentimeter pulmonary nodules should be carefully weighed against the risks.

Factors Associated With Timeliness and Equity of Access to Outpatient MRI Examinations.

OBJECTIVE: The role of MRI in guiding patients' diagnosis and treatment is increasing. Therefore, timely MRI performance prevents delays that can impact patient care. We assessed the timeliness of performing outpatient MRIs using the socio-ecological model approach and evaluated multilevel factors associated with delays. METHODS: This institutional review board-approved study included outpatient MRI examinations ordered between October 1, 2021, and December 31, 2022, for performance at a large quaternary care health system. Mean order-to-performed (OtoP) interval (in days) and prolonged OtoP interval (defined as >10 days) for MRI orders with an expected date of 1 day to examination performance were measured. Logistic regression was used to assess patient-level (demographic and social determinants of health), radiology practice-level, and community-level factors associated with prolonged OtoP interval. RESULTS: There were 126,079 MRI examination orders with expected performance within 1 day placed during the study period (56% of all MRI orders placed). After excluding duplicates, there were 97,160 orders for unique patients. Of the MRI orders, 48% had a prolonged OtoP interval, and mean OtoP interval was 18.5 days. Factors significantly associated with delay in MRI performance included public insurance (odds ratio [OR] = 1.11, P < .001), female gender (OR = 1.11, P < .001), radiology subspecialty (ie, cardiac, OR = 1.71, P < .001), and patients from areas that are most deprived (ie, highest Area Deprivation Index quintile, OR = 1.70, P < .001). DISCUSSION: Nearly half of outpatient MRI orders were delayed, performed >10 days from the expected date selected by the ordering provider. Addressing multilevel factors associated with such delays may help enhance timeliness and equity of access to MRI examinations, potentially reducing diagnostic errors and treatment delays.

Actionability of Recommendations for Additional Imaging in Head and Neck Radiology.

PURPOSE: The aims of this study were to measure the actionability of recommendations for additional imaging (RAIs) in head and neck CT and MRI, for which there is a near complete absence of best practices or guidelines; to identify the most common recommendations; and to assess radiologist factors associated with actionability. METHODS: All head and neck CT and MRI radiology reports across a multi-institution, multipractice health care system from June 1, 2021, to May 31, 2022, were retrospectively reviewed. The actionability of RAIs was scored using a validated taxonomy. The most common RAIs were identified. Actionability association with radiologist factors (gender, years out of training, fellowship training, practice type) and with trainees was measured using a mixed-effects model. RESULTS: Two hundred nine radiologists generated 60,543 reports, of which 7.2% (n = 4,382) contained RAIs. Only 3.9% of RAIs (170 of 4,382) were actionable. More than 60% of RAIs were for eight examinations: thyroid ultrasound (14.1%), neck CT (12.6%), brain MRI (6.9%), chest CT (6.5%), neck CT angiography (5.5%), temporal bone CT (5.3%), temporal bone MRI (5.2%), and pituitary MRI (4.6%). Radiologists >23 years out of training (odds ratio, 0.39; 95% confidence interval, 0.15-1.02; P = .05) and community radiologists (odds ratio, 0.53; 95% confidence interval, 0.22-1.31; P = .17) had substantially lower estimated odds of making actionable RAIs than radiologists <7 years out of training and academic radiologists, respectively. CONCLUSIONS: The studied radiologists rarely made actionable RAIs, which makes it difficult to identify and track clinically necessary RAIs to timely performance. Multifaceted quality improvement initiatives including peer comparisons, clinical decision support at the time of reporting, and the development of evidence-based best practices, may help improve tracking and timely performance of clinically necessary RAIs.

Quantifying and Reducing Errors in Vascular Imaging Examination Orders Through a Multistage Quality Improvement Intervention.

PURPOSE: The aims of this study were to quantify order error rates for vascular imaging examinations and to assess the effects of a multistage quality improvement intervention on those rates. METHODS: In this prospective, institutional review board-exempt project at a large academic quaternary care hospital, the authors aimed to quantify and reduce the order error rate by 50%. The authors analyzed 844 orders for all vascular imaging examinations placed before the intervention (July 19 to August 1, 2021, and September 13 to September 26, 2021), after an intervention in the cardiac surgery department consisting of a new customized order option in the electronic health record for routine preoperative patients (postintervention 1, February 28 to March 27, 2022); and after an educational and feedback campaign (postintervention 2, May 23 to June 5, 2022). Incorrect orders were identified by a radiology trainee during protocoling if the reasons for ordered examination and imaging examination were discordant and subsequently confirmed with the ordering provider. The primary outcome, order error rate, was compared across the project periods using the χ2 test and by ordering department using the χ2 and Fisher exact tests. RESULTS: The preintervention order error rate of 16% (50 of 306) decreased by 83% to 3% (10 of 353) at postintervention 1 (P < .001) and was durable at 3% (6 of 185) by project end. Chest CT with or without contrast constituted the majority of incorrect orders (44%, 22 of 50); "Pre-Op" was the most common examination reason (32% [16 of 50]). Cardiac surgery orderers were responsible for the most incorrect orders (32% [16 of 50]). All four most common ordering departments, including cardiac surgery, reduced their order error rates after the intervention (P < .001). CONCLUSIONS: Incorrect orders for imaging examinations can be reduced through targeted quality improvement interventions combining tailored electronic health record order options with education and feedback on practice habits.

Recommendations for Additional Imaging on Head and Neck Imaging Examinations: Interradiologist Variation and Associated Factors.

Background: A paucity of relevant guidelines may lead to pronounced variation among radiologists in issuing recommendations for additional imaging (RAI) for head and neck imaging. Objective: To explore associations of RAI for head and neck imaging examinations with examination, patient, and radiologist factors, and to assess the role of individual radiologist-specific behavior in issuing such RAI. Methods: This retrospective study included 39,200 patients (median age, 58 years; 21,855 female, 17,315 male, 30 with missing sex information) who underwent 39,200 head and neck CT or MRI examinations, interpreted by 61 radiologists, from June 1, 2021 through May 31, 2022. A natural language processing (NLP) tool with manual review of NLP results was used to identify RAI in report impressions. Interradiologist variation in RAI rates was assessed. A generalized mixed-effects model was used to assess associations between RAI and examination, patient, and radiologist factors. Results: A total of 2946 (7.5%) reports contained an RAI. Individual radiologist RAI rates ranged from 0.8% to 22.0% (median 7.1%, IQR 5.2%-10.2%), representing 27.5-fold difference between minimum and maximum values and 1.8-fold difference between 25th and 75th percentiles. In multivariable analysis, RAI likelihood was higher for CTA than for CT examinations (OR: 1.32), for examinations that included a trainee in report generation (OR: 1.23), and for patients with self-identified race of Black or African American than of White (OR: 1.25); lower for male than female patients (OR: 0.90); and associated with increasing patient age (OR: 1.09 per decade) and inversely associated with radiologist years since training (OR: 0.90 per 5 years). The model accounted for 10.9% of the likelihood of RAI. Of explainable likelihood of RAI, 25.7% was attributable to examination, patient, and radiologist factors; 74.3% was attributable to radiologist-specific behavior. Conclusion: Interradiologist variation in RAI rates for head and neck imaging was substantial. RAI appeared to be more substantially associated with individual radiologist-specific behavior than with measurable systemic factors. Clinical Impact: Quality improvement initiatives, incorporating best practices for incidental findings management, may help reduce radiologist preference-sensitive decision-making in issuing RAI for head and neck imaging and associated care variation.

Interventional Radiology Peer Learning Platform and Adverse Event Reporting (IR-PEER): Initial Experience Implementing a Team-based Novel Peer Learning System in Interventional Radiology.

Although the transition from peer review to peer learning has had favorable outcomes in diagnostic radiology, experience with implementing a team-based peer review system in interventional radiology (IR) remains limited. Peer learning systems benefit diverse IR teams composed of multiple clinical roles and could contribute value in archiving events that have potential educational value. With multiple stakeholder input from clinical roles within the IR division at our institution (ie, radiologic technologists, nurses, advanced practice providers, residents, fellows, and attending physicians), we launched a HIPAA-compliant secure IR complication and learning opportunity reporting platform in April 2022. Case submissions were monitored over the subsequent 24 weeks, with monthly dashboard reports provided to departmental leadership. Preintervention and postintervention surveys were used to assess the impact of the peer learning platform and adverse event reporting in IR (IR-PEER) on perceptions of complication reporting in the IR division across clinical roles. Ninety-two peer learning submissions were collected for a weekly average ± standard error of 3.8 ± 0.6 submissions per week, and an additional 26 submissions were collected as part of the division's ongoing monthly complication review conference, for a total of 98 unique total case references. A total of 64.1% of submissions (59 of 92) involved a complication and/or adverse event, and 35.9% of submissions (33 of 92) identified a learning opportunity (no complication or adverse event). Nurses reported that IR-PEER made the complication-reporting process easier (P = .01), and all clinical roles reported that IR-PEER improved the overall process of complication reporting. Peer learning frameworks such as IR-PEER provide a more equitable communication platform for multidisciplinary teams to capture and archive learning opportunities that support quality and safety improvement efforts.

Concordance of MRI With Pathology for Primary Staging of Rectal Cancer in Routine Clinical Practice: A Single Institution Experience.

PURPOSE: MRI is the preferred imaging modality for primary staging of rectal cancer, used to guide treatment. Patients identified with clinical stage I disease receive upfront surgical resection; those with clinical stage II or greater undergo upfront neoadjuvant therapy. Although clinical under-/over-staging may have consequences for patients and presents opportunities for organ preservation, the correlation between clinical and pathologic staging in routine clinical practice within a single institute has not been fully established. METHODS: This retrospective, Institutional Review Board-approved study, conducted at a National Cancer Institute-Designated Comprehensive Cancer Center with a multi-disciplinary rectal cancer disease center, included patients undergoing rectal MRI for primary staging January 1, 2018-August 30, 2020. Data collection included patient demographics, initial clinical stage via MRI report, pathologic diagnosis, pathologic stage, and treatment. The primary outcome was concordance of overall clinical and pathologic staging. Secondary outcomes included reasons for mismatched staging. RESULTS: A total 105 rectal adenocarcinoma patients (64 males, mean age 57 ± 12.7 years) had staging MRI followed by surgical resection. A total of 28 patients (27%) had mismatched under-/over- staging. Ten patients (10%) were understaged with mismatched T stage group (clinical stage I, pathologic stage II), five (5%) were understaged with mismatched N stage group (clinical stage I, pathologic stage III), and 13 (12%) were overstaged (clinical stage II-III, pathologic stage 0-I). Treatment matched concordance between clinical and pathologic stages was 86%. CONCLUSION: MRI for primary rectal cancer staging has high concordance with pathology. Future studies to assess strategies for reducing clinically relevant understaging would be beneficial.

Financial Impact of a Radiology Safety Net Program for Resolution of Clinically Necessary Follow-up Imaging Recommendations.

OBJECTIVE: Health care safety net (SN) programs can potentially improve patient safety and decrease risk associated with missed or delayed follow-up care, although they require financial resources. This study aimed to assess whether the revenue generated from completion of clinically necessary recommendations for additional imaging (RAI) made possible by an IT-enabled SN program could fund the required additional labor resources. METHODS: Clinically necessary RAI generated October 21, 2019, to September 24, 2021, were tracked to resolution as of April 13, 2023. A new radiology SN team worked with existing schedulers and care coordinators, performing chart review and patient and provider outreach to ensure RAI resolution. We applied relevant Current Procedural Terminology, version 4 codes of the completed imaging examinations to estimate total revenue. Coprimary outcomes included revenue generated by total performed examinations and estimated revenue attributed to SN involvement. We used Student's t test to compare the secondary outcome, RAI time interval, for higher versus lower revenue-generating modalities. RESULTS: In all, 24% (3,243) of eligible follow-up recommendations (13,670) required SN involvement. Total estimated revenue generated by performed recommended examinations was $6,116,871, with $980,628 attributed to SN. Net SN-generated revenue per 1.0 full-time equivalent was an estimated $349,768. Greatest proportion of performed examinations were cross-sectional modalities (CT, MRI, PET/CT), which were higher revenue-generating than non-cross-sectional modalities (x-ray, ultrasound, mammography), and had shorter recommendation time frames (153 versus 180 days, P < .001). DISCUSSION: The revenue generated from completion of RAI facilitated by an IT-enabled quality and safety program supplemented by an SN team can fund the required additional labor resources to improve patient safety. Realizing early revenue may require 5 to 6 months postimplementation.

MRI-Targeted, Systematic, or Combined Biopsy for Detecting Clinically Significant Prostate Cancer.

PURPOSE: The aim of this study was to assess MRI-targeted, systematic, or combined prostate biopsy for diagnosing prostate cancer to identify opportunities for diagnostic accuracy improvement. METHODS: This institutional review board-approved, retrospective study, performed at a large, quaternary hospital, included all men undergoing prostate multiparametric MRI (mpMRI) from January 1, 2015, to December 31, 2019, with prostate-specific antigen ≥ 4 ng/mL, biopsy target on mpMRI (Prostate Imaging Reporting and Data System [PI-RADS] 3-5 lesion), and combined targeted and systematic biopsy ≤6 months after MRI. Analysis included the highest grade lesion per patient. The primary outcome was prostate cancer diagnosis by grade group (GG; 1, 2, and ≥3). Secondary outcomes were rates of cancer upgrading by biopsy type and cancer proximity to the targeted biopsy site in patients upgraded by systematic biopsy. RESULTS: Two hundred sixty-seven biopsies (267 patients) were included; 94.4% (252 of 267) were biopsy naive. The most suspicious mpMRI lesion was PI-RADS 3 in 18.7% (50 of 267), PI-RADS 4 in 52.4% (140 of 267), and PI-RADS 5 in 28.8% (77 of 267). Prostate cancer was diagnosed in 68.5% (183 of 267): 22.1% (59 of 267) GG 1, 16.1% (43 of 267) GG 2, and 30.3% (81 of 267) GG ≥ 3. Combined biopsy (124 of 267) yielded more GG ≥ 2 prostate cancer diagnoses than systematic (87 of 267) or targeted (110 of 267) biopsy alone. More GG ≥ 2 cancers were upgraded by targeted biopsy than by systematic biopsy (P = .0062). Systematic biopsy upgrades were in close proximity to the targeted biopsy site in 42.1% (24 of 57); GG ≥ 3 cancers 62.5% (15 of 24) constituted most proximal misses. CONCLUSIONS: In men with prostate-specific antigen ≥ 4 ng/mL and PI-RADS 3, 4, or 5 lesion on mpMRI, combined biopsy led to more prostate cancer diagnoses than targeted or systematic biopsy alone. Cancers upgraded by systematic biopsy proximal and distant from the targeted biopsy site may indicate opportunities for biopsy and mpMRI improvement, respectively.

Impact of an Automated Closed-Loop Communication and Tracking Tool on the Rate of Recommendations for Additional Imaging in Thoracic Radiology Reports.

OBJECTIVE: Assess the effects of feedback reports and implementing a closed-loop communication system on rates of recommendations for additional imaging (RAIs) in thoracic radiology reports. METHODS: In this retrospective, institutional review board-approved study at an academic quaternary care hospital, we analyzed 176,498 thoracic radiology reports during a pre-intervention (baseline) period from April 1, 2018, to November 30, 2018; a feedback report only period from December 1, 2018, to September 30, 2019; and a closed-loop communication system plus feedback report (IT intervention) period from October 1, 2019, to December 31, 2020, promoting explicit documentation of rationale, time frame, and imaging modality for RAI, defined as complete RAI. A previously validated natural language processing tool was used to classify reports with an RAI. Primary outcome of rate of RAI was compared using a control chart. Multivariable logistic regression determined factors associated with likelihood of RAI. We also estimated the completeness of RAI in reports comparing IT intervention to baseline using χ2 statistic. RESULTS: The natural language processing tool classified 3.2% (5,682 of 176,498) reports as having an RAI; 3.5% (1,783 of 51,323) during the pre-intervention period, 3.8% (2,147 of 56,722) during the feedback report only period (odds ratio: 1.1, P = .03), and 2.6% (1,752 of 68,453) during the IT intervention period (odds ratio: 0.60, P < .001). In subanalysis, the proportion of incomplete RAI decreased from 84.0% (79 of 94) during the pre-intervention period to 48.5% (47 of 97) during the IT intervention period (P < .001). DISCUSSION: Feedback reports alone increased RAI rates, and an IT intervention promoting documentation of complete RAI in addition to feedback reports led to significant reductions in RAI rate, incomplete RAI, and improved overall completeness of the radiology recommendations.

Patient and System Factors Associated With Completed Follow-Up of Probably Benign (BI-RADS 3) Breast Imaging Findings.

OBJECTIVE: Evaluate patient factors and health system test ordering and scheduling processes associated with completed BI-RADS 3 breast imaging follow-up. METHODS: Retrospective review of reports from January 1, 2021, to July 31, 2021, identified BI-RADS 3 findings corresponding to unique patient encounters (index examinations). The electronic health record was queried for patient, examination, and health system ordering or scheduling data including follow-up order status (order placed, performed; order placed, scheduled, but not performed; order placed, unscheduled; no order placed); ordering provider specialty and health system affiliation (primary care versus other, internal versus external to health system); and ordering department (radiology staff versus referring physician staff). Patient home addresses were categorized by area deprivation index (University of Wisconsin's Neighborhood Atlas). Univariable and multivariable analysis identified patient, examination, and ordering or scheduling factors associated with completed follow-up imaging within 15 months of BI-RADS 3 assessment. RESULTS: There were 3,104 unique BI-RADS 3 assessments, 2,561 (82.5%) with completed BI-RADS 3 follow-up within 15 months of study examination. In multivariable analysis, factors associated with incomplete follow-up included ultrasound (odds ratio [OR] 0.48; 95% confidence interval [95% CI] 0.38-0.60; P < .001) and MRI (OR 0.71; 95% CI 0.50-1.00; P = .049) versus mammogram; patients living in the highest disadvantaged neighborhoods (OR 0.70; 95% CI 0.50-0.98; P = .04); patients <40 years (OR 0.14; 95% CI 0.11-0.19; P < .001); Asian race (OR 0.55; 95% CI 0.37-0.81; P = .003); order placement >3 months (OR, 0.05; 95% CI 0.02-0.16; P < .001) after index examination or scheduling >6 months after order placement (OR, 0.35; 95% CI 0.14-0.87; P = .02); order placement by breast oncology or breast surgery departments (OR 0.35; 95% CI 0.17-0.73; P = .01) versus radiology department. DISCUSSION: Incomplete BI-RADS 3 follow-up is associated with ultrasound or MRI, most socioeconomically disadvantaged patients, younger patients, Asian race, delayed order entry, and follow-up examination ordering and scheduling by non-radiology departments.

Development and External Validation of an Artificial Intelligence Model for Identifying Radiology Reports Containing Recommendations for Additional Imaging.

BACKGROUND. Reported rates of recommendations for additional imaging (RAIs) in radiology reports are low. Bidirectional encoder representations from transformers (BERT), a deep learning model pretrained to understand language context and ambiguity, has potential for identifying RAIs and thereby assisting large-scale quality improvement efforts. OBJECTIVE. The purpose of this study was to develop and externally validate an artificial intelligence (AI)-based model for identifying radiology reports containing RAIs. METHODS. This retrospective study was performed at a multisite health center. A total of 6300 radiology reports generated at one site from January 1, 2015, to June 30, 2021, were randomly selected and split by 4:1 ratio to create training (n = 5040) and test (n = 1260) sets. A total of 1260 reports generated at the center's other sites (including academic and community hospitals) from April 1 to April 30, 2022, were randomly selected as an external validation group. Referring practitioners and radiologists of varying sub-specialties manually reviewed report impressions for presence of RAIs. A BERT-based technique for identifying RAIs was developed by use of the training set. Performance of the BERT-based model and a previously developed traditional machine learning (TML) model was assessed in the test set. Finally, performance was assessed in the external validation set. The code for the BERT-based RAI model is publicly available. RESULTS. Among a total of 7419 unique patients (4133 women, 3286 men; mean age, 58.8 years), 10.0% of 7560 reports contained RAI. In the test set, the BERT-based model had 94.4% precision, 98.5% recall, and an F1 score of 96.4%. In the test set, the TML model had 69.0% precision, 65.4% recall, and an F1 score of 67.2%. In the test set, accuracy was greater for the BERT-based than for the TML model (99.2% vs 93.1%, p < .001). In the external validation set, the BERT-based model had 99.2% precision, 91.6% recall, an F1 score of 95.2%, and 99.0% accuracy. CONCLUSION. The BERT-based AI model accurately identified reports with RAIs, outperforming the TML model. High performance in the external validation set suggests the potential for other health systems to adapt the model without requiring institution-specific training. CLINICAL IMPACT. The model could potentially be used for real-time EHR monitoring for RAIs and other improvement initiatives to help ensure timely performance of clinically necessary recommended follow-up.

Development and Assessment of an Information Technology Intervention to Improve the Clarity of Radiologist Follow-up Recommendations.

Importance: It is challenging to ensure timely performance of radiologist-recommended additional imaging when radiologist recommendation language is incomplete or ambiguous. Objective: To evaluate whether voluntary use of an information technology tool with forced structured entry of recommendation attributes was associated with improved completeness of recommendations for additional imaging over time. Design, Setting, and Participants: This cohort study of imaging report data was performed at an academic quaternary care center in Boston, Massachusetts, and included consecutive adults with radiology examinations performed from September 12 to 13, 2019 (taxonomy validation), October 14 to 17, 2019 (before intervention), April 5 to 7, 2021 (1 week after intervention), and April 4 to 7, 2022 (1 year after intervention), with reports containing recommendations for additional imaging. A radiologist scored the 3 groups (preintervention group, 1-week postintervention group, and 1-year postintervention group) of 336 consecutive radiology reports (n = 1008) with recommendations for additional imaging. Intervention: Final implementation on March 27, 2021, of a voluntary closed-loop communication tool embedded in radiologist clinical workflow that required structured entry of recommendation attributes. Main Outcomes and Measures: The a priori primary outcome was completeness of recommendations for additional imaging, defined in a taxonomy created by a multidisciplinary expert panel. To validate the taxonomy, 2 radiologists independently reviewed and scored language attributes as present or absent in 247 consecutive radiology reports containing recommendations for additional imaging. Agreement was assessed with Cohen κ. Recommendation completeness over time was compared with with 1-sided Fisher exact tests and significance set at P < .05. Results: Radiology-related information for consecutive radiology reports from the 4 time periods was collected from the radiology department data warehouse, which does not include data on patient demographic characteristics or other nonimaging patient medical information. The panel defined 5 recommendation language attributes: complete (contains imaging modality, time frame, and rationale), ambiguous (equivocal, vague language), conditional (qualifying language), multiplicity (multiple options), and alternate (language favoring a different examination to that ordered). Two radiologists had more than 90% agreement (κ > 0.8) for these attributes. Completeness with use of the tool increased more than 3-fold, from 14% (46 of 336) before the intervention to 46% (153 of 336) (P < .001) 1 year after intervention; completeness in the corresponding free-text report language increased from 14% (46 of 336) before the intervention to 25% (85 of 336) (P < .001) 1 year after the intervention. Conclusions and Relevance: This study suggests that supplementing free-text dictation with voluntary use of a structured entry tool was associated with improved completeness of radiologist recommendations for additional imaging as assessed by an internally validated taxonomy. Future research is needed to assess the association with timely performance of clinically necessary recommendations and diagnostic errors. The taxonomy can be used to evaluate and build interventions to modify radiologist reporting behaviors.

Frequency and Clinical Utility of Alerts for Intra-Institutional Radiologist Discrepant Opinions.

OBJECTIVE: Determine the rate of documented notification, via an alert, for intra-institutional discrepant radiologist opinions and addended reports and resulting clinical management changes. METHODS: This institutional review board-exempt, retrospective study was performed at a large academic medical center. We defined an intra-institutional discrepant opinion as when a consultant radiologist provides a different interpretation from that formally rendered by a colleague at our institution. We implemented a discrepant opinion policy requiring closed-loop notification of the consulting radiologist's second opinion to the original radiologist, who must acknowledge this alert within 30 days. This study included all discrepant opinion alerts created December 1, 2019, to December 31, 2021, of which two radiologists and an internal medicine physician performed consensus review. Primary outcomes were degree of discrepancy and percent of discrepant opinions leading to change in clinical management. Secondary outcome was report addendum rate compared with an existing peer learning program using Fisher's exact test. RESULTS: Of 114 discrepant opinion alerts among 1,888,147 reports generated during the study period (0.006%), 58 alerts were categorized as major (50.9%), 41 as moderate (36.0%), and 15 as minor discrepancies (13.1%). Clinical management change occurred in 64 of 114 cases (56.1%). Report addendum rate for discrepant opinion alerts was 4-fold higher than for peer learning alerts at our institution (66 of 315 = 21% versus 432 of 8,273 =5.2%; P < .0001). DISCUSSION: Although discrepant intra-institutional radiologist second opinions were rare, they frequently led to changes in clinical management. Capturing these discrepancies by encouraging alert use may help optimize patient care and document what was communicated to the referring or consulting care team by consulting radiologists.

Comparing thoracic and abdominal subspecialists' follow-up recommendations for abdominal findings identified on chest CT.

PURPOSE: To compare thoracic and abdominal radiologists' follow-up recommendations for abdominal findings identified on chest CT. METHODS: This Institutional Review Board-exempt, retrospective study was performed at a large academic medical center with subspecialty radiology divisions. We used a combination of natural language processing and manual reviews to identify chest CT reports with and without abdominal findings that were interpreted by thoracic radiologists in 2019. Three random samples of reports were reviewed by two subspecialty trained abdominal radiologists for their agreement with thoracic radiologists' reporting: abdominal findings with follow-up recommendation (Group 1), abdominal findings without follow-up recommendation (Group 2), and no abdominal findings reported (Group 3). Primary outcome was agreement between thoracic and abdominal radiologists for the need for follow-up of abdominal findings. Secondary outcomes were agreement between subspecialists for the presence of abdominal findings and referring clinician adherence to recommendations. Fischer's exact test was used to compare proportions. RESULTS: Abdominal radiologists agreed with need for follow-up in 48.5% (16/33) of Group 1 cases and agreed follow-up was not necessary for 100% (34/34) of Group 2 cases (p < 0.001). Abdominal radiologists identified abdominal findings in 31.4% (11/35) of Group 3 cases, none of which required follow-up. Referring clinician adherence to thoracic radiologist follow-up recommendations for abdominal findings was 13/33 (39.4%). CONCLUSION: Abdominal radiologists frequently disagreed with thoracic radiologist recommendations for follow-up of abdominal findings on chest CT. Chest radiologists may consider abdominal subspecialty consultation or clinical decision support to reduce unnecessary imaging.

Electronic Health Record Order Entry-Based Interventions in Response to a Global Iodinated Contrast Media Shortage: Impact on Contrast-Enhanced CT Utilization.

BACKGROUND. Radiology informatics systems and clinical decision support tools in the electronic health record (EHR) can be leveraged to help impact ordering patterns in response to the ongoing global iodinated contrast media shortage. OBJECTIVE. The purpose of our study was to assess the impact of EHR order entry-based interventions, implemented as part of a health system's response to the global contrast media shortage, on contrast-enhanced CT utilization. METHODS. This retrospective study included 79,259 patients who underwent CT at a large multisite health system between April 1, 2022, and July 3, 2022. Two EHR-based interventions were implemented as part of the health system's response to the global contrast media shortage. A first EHR-based intervention on May 10, 2022, entailed creating an alert that appeared in a sidebar after any contrast-enhanced body CT orders, indicating the present shortage and recommending alternate imaging modalities. A second EHR-based intervention on May 16, 2022, required referrers to enter detailed clinical information for all contrast-enhanced body CT orders, which radiologists used when protocoling examinations. Data regarding CT orders and examinations performed were extracted from the electronic data warehouse. RESULTS. During the preintervention, first postintervention, and second postintervention periods, the mean number of patients who underwent contrast-enhanced CT per weekday was 726, 689, and 639, respectively (p for preintervention vs second postintervention periods, < .001). During the three periods, the mean number of patients who underwent CT per weekday was 1350, 1323, and 1314 (p < .001). During the three periods, the mean number of patients who underwent contrast-enhanced body CT per weekday was 561, 532, and 492 (p < .001). During the three periods, the mean number of orders for CT with IV contrast media per weekday was 154, 143, and 131 (p < .001). During the three periods, the mean number of orders for CT without IV contrast media per weekday was 196, 202, and 221 (p < .001). CONCLUSION. EHR order entry-based interventions implemented in response to the global contrast media shortage significantly reduced contrast-enhanced CT utilization in a large health system. CLINICAL IMPACT. The findings indicate the ability to rapidly achieve changes in ordering clinician behavior and subsequent clinical practice using systemwide EHR changes.